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A formula has been developed to correct laser ranging data for the 


« effects of horizontal refractivlty gradients. The formula requires the 

values of the horizontal pressure and temperature gradients at the laser 
site. The accuracy of this technique was evaluated by comparing the 
formula with range corrections which were computed by ray tracing. 



iil 


I 


TABLE OF CONTENTS 


I. INTRODUCTION 1 

II. CORRECTION FORMUIA DERIVATION 2 

in. CALCULATION OF GCj 10 

IV. RAY TRACE RANGE CORRECTIONS 18 

V. COMPARISON OF GC WITH RANGE CORRECTIONS 

DERIVED FROM RAY ^TRACING 22 

VI. EFFF.CTS OF RADIOSONDE ERRORS ON THE 

ACCURACY OF GCj 45 

VII. CONCLUSIONS 58 

APPENDIX 1. DATA USED IN THE ERROR ANALYSIS OF 

SECTION TV 80 

APPENDIX II. DtSTANCI. AND AZIMUTH TO LATITUDE 

AND LONCITUDE 82 

sF 

APPENDIX III. EVALUAliON OF — and - — i A4 

3P - 

APPENDIX IV. ' ORM OF THE STANDARD DEVIATION OF GCj. . 70 

APPENDIX V. EVALUATION OF GC., 73 

APPENDIX VI. SUMM.ARY OF PROCESSED DATA SETS 

ANT) MODE.LS 77 

REFERENCES 79 


I 


1 


t 


1 



I. INTRODUCTION 


In recent years lasei ranging systems have begun to play' an important 
role in the accurate determination of satellite orbits. For many 
applications, such as monitoring crustal movements of the earth, position 
accuracies of several centimeters or less are desirable. Atmospheric 
refraction may, however, increase the optical path length to an orbiting 
satellite by over ten meters at low elev£.tion angles. 

Various formulas have been proposed to correct laser ranging data 
for the effects of atmospheric refraction. Based on the work of Marini 
[3] and Saastamoinen (2], Marini and Murray [1] derived a correction 
formula which is attractive for satellite ranging applications because 
it requires only surface measurements of pressure, temperature, anvi 
relative humidity. The accuracy of their formula was tested by 
comparing it with range corrections calculated by ray tracing through 
atmospheric refractivity profiles. The profiles were generated from 
radiosonde measurements of pressure, temperature, and relative humidity. 

Marini and Murray’s formula was derived by assuming that a 
spherically symmetric refractivity profile adequately ( haracterized the 
atmosphere. Zanter, Gardner, and Rao [4] and Gardner and Rowlett [6] 
investigated the validity of this assumption by ray tracing through 
three-dimensional refractivity profiles. Their results indicate that 
horizontal refractivity gradients can introduce range errors of over 
three centimeters at the lower elevation angles (10® - 20®). In this 
report a correction formula which partially compensates for these 
gradient effects is derived. The accuracy of the formula is investigated 
by cnmparinc; it with range corrections calculated by r*iv tracing. 
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II • CORRECTION FORMULA DERIVATION 

Numerous formulas have been developed which partially correct laser 
satellite ranging measurements for the effects of atmospheric refraction. 
For many applications such as the monitoring of continental drift, fault 
motion and other tectonic processes, position accuracies of better than 
a few centimeters are required. Only the correction formulas developed by 
Saastamoinen [2] and Marini and Murray [1] provide this accuracy at 
elevation angles of 10 to 20 degrees. These formulas were derived under 
the assumption that atmospheric refractivity is spherically symmetric. 

This assumption holds only approximately even for the normal state of 
the troposphere. The refractivity at sea level inevitably increases from 
the warmer equatorial regions toward the colder climates at the poles - 
In the lower troposphere the surfaces of constant refractivity acquire a 
general slope toward the equator unless this is prevent . by some local 
perturbation. 

The optical path length will therefore be affected by the horizontal 
refractivity gradients. These effects are illustrated in ray-trace 
corrections reported by Zanter, Gardner, and Rao [4] and Gardner and 
Rowlett [6]. The results indicate refractivity gradients induce changes 
in the optical path length of as much as four to five centimeters at 
ten degrees elevation. 

Correction formulas which compensate for the horizontal gradients 
can be derived following an approach similar to Marini and Murray’s [1]. 
The geometry of the laser ranging site and satellite target is shown in 
Mg. 1. The optical path length between the site and target is defined 
as the integral of the group refractive index along the ray path. If the 
refractivity is spherically symmetric , the ray patli will lie entirely in a 
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plane. In this case the apparent range measured by a pulsed laser system 
is given by 


R 


0 



dr 


n 

S_ 

sin 0 


( 2 - 1 ) 


where n is the group index of refraction and 6 is given by Snell’s law 
for a spherically stratified medium (see Fig. 1) 


nr cos 0 = ^0^0 ^0 ' 


( 2 - 2 ) 


n^ is the phase refractive index at the laser site. 

The range error is the difference between the optical range Rq and 

the straight-line path length R . If n is expressed in terms of the 

s g 

group refractivity N , 

S 


n - 1 + 10"S , (2-3) 

g g 


then the range error can I'^itten in the form 


AR * R^ - R 
0 s 


10 


M 

r 1 N 



Hr - 2. , 


dr _ ^ 

Sin 6 * 

J 

Sin 0 s 

^0 


“"O J 


(2-4) 


The first term is the velocity error while the bracketed term is the 
difference between the geometric lengths of the ray and straight-line 
paths. 

Since the refractivity gradients are small (see Zanter, Gardner, and 

Rao [4] and Gardner and Rowlett [6]), we will assume the change in the 

ray path is slight so l at we need only consider the first integral in 

(2-4). N is expanded in a one-dimensional Taylor series about the lo-.r 
R 

site 
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1,1 t 


1 


N (h.p) * N + p ^ N 
g g 3p g 


2 ^2 

p«0 3p ^ 


p»0 


(2-5) 


where h is the altitude above the laser site and p is the horizontal 
coordinate measured from the ranging site in the direction of the laser 
beam trajectory. The geometry of the problem is illustrated in Fig. 1. 
Substituting (2-5) into (2-4) gives 


SC = 10 


AR - SC + GC 
-6 ... 


i;- 


sin 9 


L 'o 


sin 6 s 


GC = I GC = lO"^ I 




k=l 


k=l 


dr 

k! sin e 


( 2 - 6 ) 

(2-7) 

(2-8) 


where 


N^‘'^(h,0) = N (h.p) 


o“0 


SC is a Marini and Murray-type correction which corresponds to a spheri- 
cally syiranetric atmosphere. The gradient correction term (GC) includes 
the effects of the horizontal refractivity gradients. 

Again, since the horizontal gradients are small, we will approximate 
GC by the first term in the series, GC^. The second term, GC 2 , will be 
evaluated approximately to obtain a bound on the error introduced by 
the neglect of the higher-order terms. The problem is simplified by 
taking the p derivative after the r Integral is evaluated 


GC, 


10 


-6 


a 

3p' 


l N (h,p*)p 
dr 


sin 6 


^0 


p®0 


(2-9) 






The optical group refractivity is given by Marini and Murray [1] as 


N = 80.343 f(X) I - 11.3 f 
g T T 


( 2 - 10 ) 




7.5(T - 273.15) 
237.3 + (T - 273.15) 


( 2 - 11 ) 




( 2 - 12 ) 


P = atmospheric pressure (mb) 

T = temperature (®K) 

e = partial pressure of water vapor (mb) 

\ = optical wavelength in microns (530 for this investigation) 
Rh = relative humidity (%) • 


The water contribution is small and can be neglected in the evaluation 

of Gu^. The variation of with altitude can be determined by assuming 
the atmosphere is in hydrostatic equilibrium. From the perfect-gas law, 
the law of partial pressures, and the hydrostatic equation, we obtain 


- Mg(P - e) ^ 

" dh ~ RT RT RT 


(2-13) 


where 


M = 28.966 = molecular weight of dry air 
= 18.016 = molecular weight of water vapor 
R = 8314.36 joules (®K) ^(kg-mole) ^ = universal gas constant 
g = acceleration of gravity (m/sec). 


The pressure is obtained by integrating (2-13) 


f -Me ^ 1 

f I Y i T 


(2-14) 


is the surface pressure. Although g decreases with altitude, the 
Water vapor gradients contribute less than 1 millimeter above 10® elevation. 
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effect is small and can be neglected in (2-^14). The temperature T is 
assumed to have a linear slope 


T - T + gh 
s 

where T is the surface temperature and 3 is the temperature lap. .. rate. 
8 

The Integration in (2-14) using (2-15) gives 


-Mg/RB 


The group refractivity is obtained by substituting (2-15) and (2-16) 
into (2-10) and neglecting the water vapor contribution. 


-Mg/RB 


N = 80.343 f(X) ^1+1^ 
® s I 


The horizontal coordinate p in (2-9) is also a function of altitude, 
p may be approximated by its value along the straight-line path R 


ro sin 


’'O ^ 


+ 1 + 


(ro + h)2 - rj 


2 

tan E 


(r^, + h) 


cot E + tan E 


where E is the satellite elevation angle. When E is 10® or larger, the 
integrand in (2-9) is significant only for h less than about 100 >on. In 
this region the square root in the argument of the arc sine can be 
approximated by the first two terms in the binomial series 


p = r^ sin 


2 2 

h 1 cos^ E h 

r_ tan E 2 32 

0 tan E r^ 


I 2 

h - _ _i cos E Jh_ 

tan E 1 2 2 „ r_ 

\ tan E 0 


The term r in (?-19) is the value of p for a flat earth model. The 

tan L 

second term is a cor •' ction for the more realistic spherical earth model. 



I 


It is significant only at the lower elevation angles. 

The altitude dependence of is determined by solving (2-2) for 

Q - and expanding the result in inverse powers of sin 0^ (see G.rdner 
and Rowlett [6]). The two most significant terms are 

1,1 1 h 


sin 6 sin E . 3 _ 

sin E r 


( 2 - 20 ; 


Now substituting (2-19) and (2-20) into (2-9) and retain’ nji only first- and 
second-order terms in p ,we have 


GC - 1-0 - ^ 

1 sin E tan E 8p" 


dh N (h,p") h 
0 8 


r ill 

X - (1 + 1/2co 8^E) h_ U 

' Jl I 


V. ^IP-O 

(2-21) 

The integrals can now be evaluated by using the expression in (2-17) 


for N 


GC, = — r^- (P T K ) 

I sin E tan E 3p s s s 


C = 80.343 f(A) 


D = -80.343 f(X) 


^ ^ 10-^ 


. D(1 + l/2cos^ E) 

3 


3 

P=0 sin E tan E 

3p 

\2 - kJ|p*0 



('2-22) 

.915 X 10*^ f(A) (m) 



* -6.362 X lo'^ f(X) 

(m) 



where r^ is taken as the nominal earth radius (6378 km), and g has been 

set equal to 9.784. The correction term GC^ is given in meters when the 

listed values for C and D are used and the derivatives are in units ('f 

m The value ot depends on the temperature lapse rate 6. Marini 

and Murray [1^ derived an empirical expression for K by numerically 
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Integrating through atmospheres of the U.S. Standard Atmosphere Supplements 
(1966) and applying a linear regression fit to the values 


K = 1.163 f 0.00968 cos 20 - 0.00104T + 0.00001435P 
s s s 


(2-23) 


0 - colatitude of laser site 

The first term in (2-22) is typically three to four centimeters at 10® 
elevation while the second term is generally one centimeter or less. At 
10® elevation roughly two-thirds of the contribution of the second term 
arises from the expansion of ^ (Eq. (2-20)). The remaining contribution 
is from the spherical earth correction factor in the expansion of p 
(Eq. (2-19)). 

The error introduced by neglecting higher-order terms of GC can be 
estimated by obtaining a bound on the s-cond term in the series 


-2 ^0 


N (h,p') p' 

-Q 

sin 0 


2 sin E tan E |0p 




dh h > P * 


(2-24) 


This integral can be evaluated by substituting the e:’.; resslon given in 
(2-17) for N 


/ ,2 .1 

. 80.343 f(X) -6 8^ ^s^s^^s 

^’^2 ' . 2 ^ 7773 :*2 

Sin h tnn E (Mg) . s 


(2-25) 


2.029 f<») 5^ 


'2 ' , ^ ^ 2 „ . 2 .2 - K I 
sin E tan E 3p \ s / 1 


GC^ *s given in meters when the derivative is in units of m 
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III* CALCULATION OF GC^ 

Data used in evaluating GC^ were obtained from radiosonde balloon 
releases of Project Haven Hop I [5J. Figure 2 displays the locations the 
radiosonde release sites. Most sites are seen to be centered about the 
Vashington» D.C* area and to be displaced 100 to 150 kilometers from one 
another. The radiosondes were released within a few minutes of each 
other at various times throughout the night and day during January and 
February of 1970. The balloons monitored pressure, te* perature, and 
relative humidity periodically during their ascent through the atmosphere. 

Equation (2-22) is based on a spherical earth model. Data used in 
evaluating (2-22) should reflect this sKHieling, i.e*, values of pressure 
and temperature should be obtained from a spherical surface. The raw 
radiosonde data violated this modeling in two respects. First, for any 
given group of release sites, each site was a different altitude above 
sea level. Second, since each balloon was monitored only periodically, 
raw data points were arbitrary with respect to altitude and to the other 
balloons in the group. 

These inconsistencies were removed from any group of balloon release 
sites by selecting the altitude of the highest site as the first altitude 
at which radiosonde data would be available from all stations. Typically 
this altitude was 140 meters above sea level. Data from the other balloons 
in the group were interpolated to this altitude using the interpolation 
procedures described in [1] and [4] for ray-tracing applications. 

Method I Two methods were used to evaluate (2-22), or, more 

3 3 ^s'^s s 

specifically, the derivatives *:r“ T K ) and ~ ^ • Method i 

' ’ 3p s s s V 2 - K 

s 

approximates the derivatives as 


I 


i 


t 


I 


I 




I 


12 


A (P I K > - 

s S S 


(3-1) 


and 


9p 


/ 2 2 '^21 
/P T K \ i 

sss|_ 111 000 1 


2 - I ^2 - 2 - K„ ' P„, 


(3-2) 


where the subscript 0 indicates the ranging site and the subscript 1 an 
outlying site located beneath the laser beam trajectory, is the 

distance between the two sites (see Fig. 1). The approximate derivatives 
in (3-1) and (3-2) become more accurate as approaches zero. 

Equations (3-1), (3-2), and thus (2-22) could be evaluated using 
the raw radiosonde data interpolated to the height of the highest site. 

For the case where the laser site is located at 54, evaluations of GC^ 
would be restricted to azimuths corresponding to those of the peripheral 
radiosonde sites. In addition the error in would be a strong function 
of the error in any single radiosonde measurement. 

These limitations were partially overcome by modeling the interpolated 
pressure and temperature of a group of sites using a polynomial regression 
analysis. The interpolated pressure or temperature was chosen as the 
dependent variable, and colatitude and longitude the independent variables 
of a multiple regression fit. The regression generated a polynomial 
giving surface pressure or temperature as a function of location. Note 
two regressions were performed for each group of sites, one for temperature 
and another for pressure. In this manner a pressure surface and a 
temperature surface were created in the vicinity of the laser ranging 
site at the altitude of the highest site. These surfaces yielded the 
least squares fit to the interpolated adiosonde data. The polynomial 
models employed in the regression analysis arc given by (3-3) through (3-5) 
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t 
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I 



t i ^ 

I 

I 

4 

i 

i 

4 

I 

(3-3) 

(3-4) 

(3-5) 


A minimum of six data points is required to determine the regression 
coefficients in (3-3), four to determine (3-4), and three to determine 
(3-5). 

Range corrections calculated by ray tracing wt ♦ c.jmpared with C»C^ 
in order to ascertain its usefulness in correcting refraction effects 
(see Section IV and Gardner an! Rowlett (6]). The particular polynomial 
employed was chosen to be the same as the refract ivity model used in per- 
forming the ray traces. By using more than the minimum number of stations 
required to determine a given polynomial the regression served to average 
out some of the radiosonde errors (see Section VI). Data from eight 
i adiosonde stations were used for quadratic (3-3), or linear (3-5) modeling 
of ^^ressure and temperature and seven or eight stations for a linear 
plus cross term model (3-4). 

Equations (3-3) th.rough (3-5) allow pressure and temperature to 
be calculated at any point in the vicinity of the laser ranging site. 



Therefore, GC^ may be calculated at any azimuth or elevation relative 
to the ranging site. It is also possible to arbitrarily vary 
Because of its central location, site 54 (see Fig. 2) was the ranging site 
for this investigation. 

A typical evaluation of GC^ proceeds as folic ws. A model for the 
pressure and temperature surfaces is selected from (3~3) through (3-5). 

The data of the appropriate number of stations (7 or 8) are then inter- 
polated to the altitude of the highest station. Two multiple regressions 
are performed to evaluate regression coefficients which are used to cal- 
culate pressure and temperature at the ranging site and at another point 
a distance from the ranging site. These values are used to evaluate 
(3-1) and (3-2) which are then substituted into (2-22) to yield GC^. 

Method II Using Method II the directional derivatives (3-6) and 
(3-7) are explicitly evaluated at the laser ranging site 


(P T K ) 
3p s s s 


9p 12 - K 


(3-6) 


(3-7) 


The interpolated radiosonde data were used to calculate the quantities 
2 2 

PTK 'nd [PT K /(2 - K)] at each release station at the altitude of the 

highest station. These two parameters were then used as the dependent 

variables of two multiple regressions. The regressions generated poly- 

P t2r 2 
s s s 

nomials expressing PTK and -z ^ as a function of location. The modeling 

s s s ^ — K 

s 

of the two quantities was restricted to be linear or quadratic as given by 
'"J-P) and (3-9). 


F = F + <3 * F„ + (f. sin O • F. 
r 0 (t 


(3-8) 


T 
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I 


I 


F « F + 9 • F. + sin e • + 6(|i sin 9 • F.^ + 6 • F„„ 

To 9 vG 

2 2 

+ <|>^ sin 0 • 


( 3 - 9 ) 


where 


^»^e*%‘%*^9e’^0 * coefficients 

P 

F = P T K or . 

s s s 2 ~ K 

s 


As in Method I a minimum number of three data points is required to 
determine the coefficients for model (3-8) and six data points are required 
for model (3-9). Error averaging in the radiosonde data was achieved by 
using more than the minimum number of stations in the regressions 
determining (3-8) and (3-9). Eight data points were used to determine both 
(3-8) and (3-9) . Gradient corrections obtained using Method II were 
compared with ray traces calculated using quadratic modeling of 

atmospheric refractivity (see Section IV). 

3F 

The evaluation of — is simplified by expressing 6, and 9, as 

dp X i 

functions of p. Note that p is the horizontal coordinate measured from 
the ranging site along the surface of the earth in the direction of the 
laser beam. Due to the curvature of the earth p does not lie in a plane 
(s3e Fig. 3). For this reason spherical trigonometry must be used to 
express 9^^® functions of p. The coordinate transformation is 

given in Appendix II. The results are given in Eqs. (3-10) and (3-11) 
below. 


-1 r ^01 ^01 

6 = cos ;cos 9^ cos — + sin 0^ sin — cos a 

1 Or Or 

L e e , 


^ -1 fsin a ^ ^Oll 

Pr, + sin I*—; — r sin ^ 

^0 sin 9^ r 


where 


^0*^0 ” colatitiide and longitude of ranging site 

r = radius of the earth 
e 


(3-10) 

(3-11) 


01 * 


n = azimuth of p 



*n,w>#(B9w ; 


„.L 


Note longitudes west of the prime meridian are taken as negative. 

Equations (3-10) and (3-11) may be employed, using the chain rule, 

3F 3F 

to determine — . Separate evaluations of — are required for the linear 
op dp 

model (3-8) and the quadratic model (3-9) • Appendix III outlines the 
steps necessary in this evaluation. The results are given by (3-12) and 
(3-13). 


linear - 
P-0 


^ p9 * *0 <=»» *0 • "t] * ^ ■ % (3-12) 


[ f , + *0 ®0 • * *0 ®0 • ^ 6 * 

e *o0o «o • ■'e* * • ''ee * ♦o ^«o ‘ 


Lp [, 

a ^ 


®o * 


(3-13) 


To summarize. Method II uses the interpolated radiosonde data from 

eight stations to calculate regression coefficients for the parameters 
2 2 

P T K and PTK/(2-K). The form of the regression modeling is 
s s s s S S S 

given by (3-8) or (3-9). The regression coefficients are then substituted 

3F 

into the explicit evaluation of the derivatives — (evaluated at p * 0). 

dp 

Equation (3-12) was used for the linear model and (3-13) for the quadratic 

model. Two evaluations of (3-12) or (3-13) are required; one using the 

regression coefficients for another using the regression 

2 2 

coefficients for PTK/(2-K). GC-. Is then calculated by substituting 
s s S S ^ /X 

3P T K P T^K^ 

the values of — ■ - and — - into Equation (2-22). 

p=0 „ 

0=0 
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IV. RAY TRACE RANGE CORRECTIONS 


The ability of GCj^ to correct laser ranging data for the effects of 
horizontal refractivity gradients has been investigated. GC^ was compared 
with range corrections obtained by ray tracing through three-diiuensional 
refractivity profiles. The profiles were constructed using meteorological 
data gathered in Project Haven Hop I (5J. The Haven Hop data consist of 
pressure, temperature and humidity measurements obtained by radiosonde 
balloons which were released from eleven different locations around the 
Washington, D.C. area during January and February of 1970. The balloon 
release sites are indicated on the map in Fig. 2. The balloons were 
released within a few minutes of each other at various times during the 
night and day and tracked to an average alt'^ude of 15 km. 

At optical frequencies the phase refractivity is given by 


N == '287.604 + 


1.6288 0.0136 

( A \ 

f 273.15\ 

) 

\l013.25l 

1 T 1 




11.2683 Y 


where 

X = laser wavelength (urn) 

P = atmospheric pressure (mb) 

T = atmospheric temperature (°K) 
e = water vapor pressure (mb). 


(4-1) 


The group refractivity can be calculated from (4~1) 


N = N - A ^ = 80.J43f(X) | - 11.27 f 
g dX IT 


(4-2) 



where f(A) is given by Eq. (2-12). 

Radiosonde observations consist of temperature, pressure, and humidity 
measurements taken from the surface up to the point where the balloon bursts. 
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The measurements are obtained at certain standard and significant levels 
during the balloon ascent- The data can be used in conjunction with 
Eqs. (4-M and (4-2) to construct refractivity profiles along the balloon 
ascent path from the surface up to the point of highest measurement. Above 
the latter point, the refractivity profile can be extended by assuming a 
suitable temperature profile. The procedure for constructing the refracti- 
vity profiles from the radiosonde data is straightforward and is discussed in 
detail in Gardner and Rowlett's report [6]- 

Three-dimensional refractivity profiles can be constructed from the 
radiosonde profiles by assuming a suitable model for the horizontal 
refractivity variations. Zanter, Gardner, and Rao [4] used a linear 
model which required three radiosonde profiles to determine the model 
parameters. Gardner and Rowlett [6] extended the model to allow for 
quadratic variations in the horizontal direction. In the present case the 
refractivity at any point can be written in the form 

N(r) * N^(h) + 0 • N^(h) + sin e • N^(h) + e<\> sin 9 • 

+ • NgQ(h) + (t,^ sin^ 0 • N^^(h) (4-3) 

where h is the altitude and 0 and (|i are the colatitude and longitude of 
the vector £ = (h,9,(}>). 0 is proportional to horizontal displacement in 

the north-south direction and 4> sin 0 is proportional to horizontal dis- 
placement in the east-west direction. The six coefficients M^, N^, N^, 

-^nd N^, are constant with respect to 0 and <|) but can change 

0 (() 06 99 

with altitude. 

If the refractivity is known at six or more points, the coefficients 
for any altitude can be calculated using multiple regression. Equipment 
failures and balloon malfunctions limited the amount of acceptable 
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radiosonde data to thirty-one releases involving groups of seven or eight 
balloons per release. When eight radiosonde profiles were available the 
quadratic model in (4-3) was employed. To reduce the error in the 
regression coefficients, a four-coefficient model was employed when only 
seven radiosonde profiles were available. 

N(r) » N (h) + 0 • N.(h) + * sin 6 • N^(h) + 64> sin 0 • N^^(h) . (4-4) 

“ r y 9 u(p 

The phase and group refractivity at any point (h,0,9) can be computed 
from the radiosonde data using Eqs. (4-1)- (4-4). The pressure, temperature 
and humidity measured by each radiosonde are used to construct continuous 
profiles of group and phase refractivity along seven or eight balloon 
ascent paths using (4-1) and (4-2). The coefficients for the models in 
(4-3) and (4-4) are calculated from these profiles using multiple 
regression. The coefficients are substituted into (4-3) and (4-4) to 
obtain the three-dimensional refractivity profiles which can then be 
employed in the ray-tracing programs. 

Range corrections were computed by ray tracing through the three- 
dimensional refractivity profiles. These corrections are denoted by RT^* 
RT^ is dependent on azimuth since the refractivity is assumed to vary in 
the horizontal direction. Therefore, azimuth was varied from 0® to 360® 
in 10® increments. Ray-trace corrections were calculated for each set 
of radiosonde data at 10®, 20®, 40® and 80® elevation. The laser tracking 
station was assumed to be located at site 54 in Leonardstown, Md. 

(Fig. 2). An additional range correction, RT^^, was also computed by ray 
tracing through a suitable spherically symmetric profile constructed from 
radiosonde data. RT^ includes the effects of horizontal gradients, while 
RT^ contains no gradient effects. The difference between RT^ and RT^ 
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Is the range error contributed by the horizontal refractlvlty gradients. 
Complete details of the ray-tracing procedure are available In reference [6] 
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V. COMPARISON OF GC^ WITH RANGE CORRECTIONS DERIVED FROM RAY TRACING 

A total of 31 sets of data ^ere processed to determine the accuracy 
with which GC^ corrected for atmospheric refractivity gradients. Each 
set employed the meteorological data from a relec*se eight radiosonde 
balloons to calculate GC^ and perform ray traces. Ray-trace correction 
terras were calculated for each set at 10® increments in azimuth and 
elevations of 10, 20, 40 and 80 degrees. RT^ is the e correction 
obtained by ray tracing through tb ee-dimensional ref vity profiles. 

It contains the effects of horizontal gradients and depends on both 
azimuth and elevation. RT^ is the ange correction obtained by ray 
tracing through spherically S 3 nranetric refractivity profiles. The gradient 
effects in the ranging data are isolated by calculating the term RT^ - RT^. 
Any effects not compensated for by GC^ are given by the e^'ror term 
A = (RT^ ^ RT^) - GCy 

A value of GC^ was calculated for comparison with each ray trace 
usin^. each of the methods outlined in Section III. They are briefly 
summarized as follows: 

MODEL a: Use Method I to approximate the derivatives (3-1 ) and 

(3-2) and use a quadratic model (3-3) for the surface 
pressure and temperature. 

MODEL b: Use Method I and employ '' four-coei. ficient (3-4) model for 

the surface pressure and temper'=»*'are. 


MODEL c: Use Method II to evaluate the derivatives (3-12) and (3-13) 

2 2 
P T K 
s s s 

and use a linear model for P T K and -r — . 

s s s ^ - K 

s 

MODEL d: Use Method II and employ a quadratic model for P T K and 

2 2 ® ® ® 

P T K 
s s s 

2 - K • 
s 


i 
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The 31 data sets may be divided into three groups* Group A con- 
sisted of 21 sets of data evaluated using modeling scheme a. Group B 
consisted of 10 arbitrarily selected sets from Group A which were 

* 

reevaluated using the remaining modeling schemes b, c, and d. Group C 
consisted of 10 sets of data evaluated using mode ing scheme b, x^e 

groups and models are 3uimnarlzed in Appendix VI* 

Thirty-six range corrections, RT^ (one for every 10^ increment in 

azimuth), were calculated for each data set at each elevation angle. A 
single value of RT^^ was obtained for each data set at each elevation. 
Therefore there were 756 values of the uncorrected gradient error 
RT^ - RT^ calculated for Group A at each elevation ai -^le. Similarly, 

360 values of RT^ “ RT^ were calculated for Groups B and C at each 
elevation angle. Table 1 gives the mean and standard deviation of 
RT^ - RT^ for each group. The values of RT^ used in these calculitions 
employed quadratic refractivity models for groups A and B. Group C 
employed a four-coefficient refractivity model. In addition, group B 
was reprocessed using a four- nefficient refractivity model and given 
the designation Bb in agreement with the labeling scheme for 


TABLE 1. 

RT^ - RT^ UNCORRECTED GRADIENT 1 ’ROR (cm) 

Elevation 10^ 20° 40° 80° 


Group 

Std 

Mean 

Std 

Mean 

Std 

Mean 

Std 

Mean 

A 

1.96 

.01 

.51 

o 

o 

.12 

.00 

.01 

.00 

1 

B 

1.90 

-.10 

.50 

1 

o 

.12 

.00 

.01 

o 

O 

Bb 

1.76 

-.22 

.46 

-.03 

.11 

.00 

.01 

1 

.00 1 

C 

i — 

1.90 

-.01 

.29 

.01 

1 

.11 

.00 

.01 

.00 
— a 


>^Group A, B and Bb ray traces were obtained using eight radiosonde profiles. 
Group C ray traces were obtained using seven radiosonde profiles. 
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Tables 2 through 5 give the mean and standard deviation of the residual 
error A “ ^^^3 “ ^ groups and models. Comparison of 

Table 1 with Tables 2 through 5 indicates the standard deviation of the 
uncorrected gradient error has been reduced by almost or -half. 


TABLE 2. 

ERROR AFTER CORRECTION A (cm) E = 10* + 

GROUP A GROiJP B GROUP C 



Std 

Mean 

Std 

Mean 

Std 

Mean 

{ Model a 

1.19 

.06 

1.17 

0 
• 

1 



Model b 



1.13 

.01 

1.41 

-.22 

Model c 



1.30 

-.09 



1 

; Model d 

\ 

i 



1.16 

-.10 

i 



TABLE 3. 

ERROR AFTER CORRECTION A (cm) E = 20* + 


GROUP A GROUP B GROUP C 



Std 

Mean 

Std 

Mean 

Std 

J 

Mean 

Model a 

.31 

.02 

.31 

•H 

O 

• 



Model b 



.30 

.01 

.37 

1 

b 

Model c 

( 

1 



.31 

-.01 

1 

1 

I 

j Model d 



1 -31 

1 

-.01 

1 

i 

1 



I '• 


1 1 i 
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TABLE 4. 

ERROR AFTER CORRECTION A (cm) E = 40* + 



GROUP A 

GROUP B 

GROUP C 


Std Mean 

Std Mean 

Std Mean 

^k>del a 

.07 .04 

.07 .00 


Model b 


0 

0 

• 

0 

t 

.09 -.00 

[ 

Model c 


.07 .00 


Model d 

1 

1 

.07 .00 



TABLE 5. 

ERROR AFTER CORRECTION A (cm) E = 80* + 

GROUP A GROUP B GROUP C 



Std Mean 

Std Mean 

Std Mean 

; Model a 

.01 .00 

.01 .00 


j Model b 


.01 .00 

1 

.01 .00 

Model c 


0 

0 

0 


Mode 1 d 
1 i 


.01 .00 

1 



+ 

Results given for models a and b use a separation distance 
= 25 km. Group /M del Be was compared with RT 3 - RT^^, 
calculated using a quadratic refractivity profile for RT^. 

The mean and standard deviation of RT^ RT^ and A were computed for 
each azimuth and elevation angle. The results for Group/Model Aa are 
plotted in Figs. 4 through 11. GC^ effectively removes the large biases 
in RT^ - RTj^ at each azimuth. However, the reduction in the mean 
imcorrectod error (^^T^ ~ been accompanied by an increase in the 

standard deviation of the error after correction. We believe the increase 
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Figure 6. Mean of RT^ - RT^ and (RT^ • RT^) - 
Elevation 20®. Twenty-one data se 
Processed using Model a (see page ; 
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Figure 8. Mean of RT^ - RTj^ and (RT^ - RTj^) - GCj^ versus azimuth. 


Elevation 40®. Twenty-one data sets comprising Group A. 
Processed using Model a (see page 78 ) 
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Figure 9. Standard deviation of RT^ - RTj^ and (RT^ - RTj^) - GCj^ versus 
azimuth. Elevation 40“ . Twenty-one data sets comprising 
Group A. Processed using Model a (see page7g ) 
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Figure 11. Standard deviation i 
azimuth. Elevation 
Group A. Processed 
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can be attributed to raeasurenent errors In the radiosonde data which are 
used to calculate GC^ (see Section VI). The E » 80* curve shows the 
^ effects of computer round-off noise in the ray-trace routine (see Gardner 

and Rowlett [6]). 

In evaluating GC^, Method Z uses (3-1) and (3-2) to approximate .he 
derivatives. The accuracy of this approximation would be expected to 
inq>rove as becomes small. The effect of varying is shown in 
Figs. 12 and 13, where corrections using Group/Models Aa, Ba, Bb and Cb 
are compared. Values of A for these groups were calculated for 10* 
increments in azimuth and separations = 25, SO, 100, 150, 200 and 
300 kilometers. The elevation angle is 10*. For each p^^ the mean and 
standard deviation of A was calculated and plotted as shown. The plots 
converge for Aa, Ba and Bb at p^^ ^ 25 km. If we examine the results in 
Tables 2 through 5, and compare Models c and d with Models a and b 
(results for ■ 25 km are given in the tables), we see Methods I and II 
give approximately the same residual errors for small Pqj^* 

Group/Model Cb has a higher mean and standard deviation than the 
I other groups. Recall the radiosonde releases in Group C contained only 

seven balloons per release while A and B contained eight. This degrada- 
tion in the magnitude of the residuals. A, can be attributed to the 
reduction in the number of monitoring stations (see Section VI). The 
flatness of the curves employing the four-coefficient model is due to the 
inherent linearity of the model Itself. Regardless of the two points we 
select on a linearly modeled P T K surface, the gradient or slope will 
always be a constant. Therefore we would not expect GC^^ to vary with 

p^, under this modeling scheme, 
ui 
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Figure 12, Mean residual error (RT^ - RTj^) - versus for Group/ 
ModelF Aa, Ba» Bb, Cb. Group A consists of 21 data s#»ts. 

Group B consists of 10 arbitrarily selected data sets of 
Group A. Groups A and B employ radiosonde releases consisting 
of 8 balloons. Group C consists of 10 data sets employing 
7 radiosonde balloons. Models are explained on page 78. 
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Figure 13. Standard deviation of the residual error (RT^ - RT^^) 

versus for Group/Models Aa, Ba, Bb, Cb. Group A consists 
of 21 data sets. Group B consists of 10 arbitrarily selected 
data sets of Group A. Groups A and B employ radiosonde releases 
consisting of 8 balloons. Group C consists of 10 data sets 
employing 7 radiosonde balloons. Models are explained on 

page 78. 
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A typical correctluii of two data sets from Group/Hodel Bd Is shown 
in Figs. 14 and 15 where we have plotted RT^ - RT^ and A versus azimuth. 
Figure 14 shows data of 1530 2/16/70 elevation 10®. GC^ was fairly 
effective in reducing the gradient errors RT^ - RT^. The mean and standard 
deviations of the 36 residual errors A are -.34 and .34 centimeters, 
respectively. Figure 15 shows data of 1730 2/16/70. GCj^ was not as 
effective in this data set. The mean and standard de lation of the 
36 A*s at 10® elevation are .25 and .84 centimeters, respectively. 

Figures 16 through 19 are histograms of RT^ - RT^ and A for the 
21 sets of data processed using Group/Model Aa. Elevations are 10 and 
20 degrees. Peak gradient error 3 are seen to be reduced through the 
addition of GC^. Figure 20 gives the percentage of the uncorrected 
errors, RT^ - RT^* and the errors after corre-^tion. A, less than 
the abscissa value for E = 10® and Group /Model Aa. Approximately 
?8 percent of the errors before correction were less than ±1 cm. A^rer 
correction approximately 53 percent of the residua? errors were less than 
±1 cm. 

It is important to note that, regardless cl the method used to 
evaluate GC^^, the mean and standard deviation of tne residual errors L 
are comparable. Improvements in A are obtained by varying p and the 
number of outlying meteorological stations. These factors must be con- 
sidereo in establishing a ranging facility of a given accuracy. Section VI 
considers the effects of varying the number of stations and errors in the 
radiosonde data on the standard deviation of A. 
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Figure 15. Typical correction of gradient errors RT^ - and residual 

errors (RT^ - RT^) - GC^ versus asimuth. Data of 2/16/70 1730 
(froia Group B) processed usin»; Model d (See page 7S) • 




NUMBER OF SAMPLES 






NUMBER OF SAMPLES 


ELEVATION * lO’ 
MEAN » .06 cm 
STANDARD DEVIATION 


n i 

- 8.0 


- 6.0 


Figure 17. 


(RT3' RT,) - GC, (cm) 


Histogram of residual gradient errors (RT^ - - GCj^. 

Elevation • 10*. Twenty- one data sets comprising Group A 
processed using Model a. Mean •* .06 cm* Standard devia- 
tion « 1.19 CO. 
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Figure 18. Histogram of uncorrected gradient errors RT^ - RTj^. 

Elevation > 20”. Twenty-one data sets comprising 
Group A processed using (fodel a. Mean ■ .00 cm. 
Standard deviation ■ .51 cm. 
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Figure 20. Percentage of errors less than the abscissa value before 
and after correction. Group/Model Aa (twenty-one data 
sets) . Models are explained on page 73. 





VI. EFFECTS OF BADIOSONDE MEASUREMENT ERRORS 
ON THE ACCURACY OF GC, 


Errors in surface neasureaents will of course Introduce errors Into 
the gradient correction term. The magnitude of these effects can be 
estimated from an analysis of the standard error of the regression 
coefficients which were used to obtain a least-squares fit of the surface 
data. The error is a function of the order of the regression pol 3 momial 
and the locations of the surface %reather stations. To illustrate the 
procedure we will calculate the error that would be expected using the 
Haven Hop radiosonde data. 

The first term in (2-22) is the most significant. Therefore 
the standard deviation of GC^ can be approximated by 


’ iisnrnn i <W.> 

Std p« 


JStd 


In the most general case the parameter P T K is expanded in a two- 

S 8 S 

dimensional m^^ order regression polynomial 


Ws w 

k*l 


where the variables are the coordinate polynomials and the are the 
regression coefficients. For a linear regression model we have 


Xi- 1 

X2-e 

Xj ■ sin 0 


Bi-F^ 
®2 • ^9 


The derivative of P T K can be related to the regression fit by (6-4). 

s s s 






^ - 




® * ® P-0 k-1 *■ P-0 


(6-A) 


The standard deviation of the derivative is related to the variances and 
covariances of the regression coefficients by (6-3). 




mm 3X, 3X, 

y Y c — i-J 

^ ^ ^k£ 3p 3p 


k-1 t-1 


(6-5) 


where 


'kk"™' <®k>- 


(6-6) 


The regression coefficients are calculated by measuring P T K at n > t 

8 8 8 

different weather stations. Let F, be the i*^" measurement of P T K which 

i s s s 

is made at the coordinates . . .X^^^). Define X as the n x m matrix 

t h t h 

containing X^^ in its i row and j column. 


X 1 

nl 


(6-7) 


Also define the column vectors 


F - [F^,F2.. 




.6 1 ^ . 

m 


( 6 - 8 ) 


The least-squares regression solution for the 8 matrix is 


T -1 T 
8 » (XX) X F 


(6-9) 


1 ,A 




The a X ■ variance-coveriance matrix ^ for the regreaalon coeff icienta is 
given by 


T -1 2 

C - (X X) ^ a 


( 6 - 10 ) 


where o is the standard measurement error of P_T K , i.e., F. 

8 8 8 

In our analysis two-dimensional, first- and second-order regression 

polynomials were calculated for the parameter P T R . For 8i^>liclty 

8 8 8 

T 

we iflll consider only the linear regression fit. The matrix X X is given 




^ J \2 i *t2\3 • 

lt«l k.l k.l •t'* 


^ \3*kl I hi\2 I ^3 

j^k^l K1 KJ K£ KJ 


The coordinates Xj^, X 2 and X^ are defined in (6-3). X 2 and X^ are the 
horizontal displacements in the north-south and east-west directions. 
Since the radius of the earth is large, we can represent X 2 and X^ 
approximately iu polar coordinates with the origin taken as the location 
of site 54. 


Xi-1 

X 2 ■ p cos a 
Xj * p sin o 


( 6 - 12 ) 


where a is the azimuth angle of p. Note X 2 and X^ are zero at site 54. 

th T 

If we let the measurement of taken at site 54, the XX matrix 

0 s s 


becomes 
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2 
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2 
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k-l 


k-l 

n-1 

1 

"k 

sin 

n-1 

1 

2 

^k 

cos sin 

n-1 

I 

k«l 



k»l 



k=l 
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2 , 2 
)k sin 


(6-13) 


The variance-covariance matrix £ is fairly easy to calculate from (6-13) 
if we make some simplifying assumptions about the placement of the weather 
stations. For the Haven Hop data the stations are roughly located on the 


perimeter of a circle centered at site 54. If we let p 
replace pj^ by p, (6-13) becomes 



n-1 
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k*l 


p, and 
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n-1 

n-1 


— r 


n 

p 1 cos a 

p 1 
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-2 

n-1 
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-2 

n-1 
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1 
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P 

1 

cos a, 
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1 

k-l 
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k-l 

iC 


k-l 

n-1 
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cos sin 
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1 

k-l 



k-l 
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cos sin 


sin^ a. 


(6-14) 

If the stations are uniformly distributed along the circle perimeter and 

n is sufficiently large, the off-diagonal terms are approximately zero 

-2 ^ 

and summations in the diagonal terms are approximately ^ 
this case the variance-covariance matrix is given by 
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a 

n 


2a 

(n - 1) 


2a 


(n - 1) 


(6-15) 


The standard error in can now be calculated by substituting (6-15) 
into (6-5) and using the result in (6-1) 


Approx. (GC, ) 


1 Std sin E tan £ 


/Xl£ 

/n - 1 - 


(6-16) 


where a Is the standard measurement error of P T K • o can be expressed 

s s s 


in terms of the standard errors of P and T . 

s s 


a = P T K 
s s s 



^ 1.04 X 10"^T \ 

2 'T] 

a„“ 

p . 

1 - ® 

T 


r K 

^ 2 

P 

[ 8 j 

T 

L s 


8 J 


1/2 


(6-17) 


Alternatively the error can be determined by evaluating (6-10) 
exactly using the locations of the radiosonde stations in the Project 
Haven Hop network. 

From (6-1) and (6-5) the standard error in is 




sin E tan E 
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1 

1 C 

k-l 

£-1 ' 


k£ 3p 3p 


t1/2 


p*0 


( 6 - 18 ) 
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The coordinate polynomials In (6-2) are 
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4isln6 


■ 0(^sin6 
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X, * i}i sin 0 

D 


(6-19) 


The coordinate matrix X (6-7) is calculated using the defined above 

evaluated at the colatitude and longitude of the radiosonde release sites. 
The colatitudes and longitudes are given in Appendix I. The X matrix is 
then used to evaluate the variance - covariance niatrix C. 



C has been calculated for the Haven Hop network and is given in Appendix I 

for linear, 4 coefficient, and quadratic models of P T K • 

s s s 

If we let the ranging site be 54 and 


P = 1000 mb 
s 

T -- 275'* K 

3 

K - .88913 
s 

0^ = .7^ K 

0 * . 7 mb 

P 

and substitute these values into (6-17) we obtain 

a » 455.57. 

The values of pressure, temperature, , nd are typical ot the Haven Hop 
data. The standard errors in pressure and temperature were obtained f rom 
Hoidale et al.[7]. Equation (6-18) requires the derivatives of the 
coordinate polynomials Xj^ with respect to p, evaluated at p*0. 

From Appendix III they are 
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(6-21) 
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The derivatives of (6-21) are functions of azimuth. Therefore the 
estimated error f ^^l^Std* have an azimuti.al dependence. Equation 

(6-18) for the estimated error has been evaluated using the three models 
for P T K and plotted as in Figures 21, 22, and 23. On the same graphs 

8 S 8 

is the actual standard deviation of the residua, errors A for Grcui] /llodels 
Be, Bd, and Bb, respectively* The value of averaged over all 

azimuths is given below for each model* 


(GC )„ , - .45 centimeters 

X o L Q 

linear 

(GC ) , , - .46 centimeters 

I'^Std 
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‘“I'std 


quadratic 


(6-22) 
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Figure 22. Standard deviation of (RT^ - RTj^) - and the estimated 
standard deviation of GC^ due to radiosonde measurement 
errors of .7*C and .7 mb versus azimuth. Elevation ■ 10". 
Group B consisting of 10 arbitrary data sets from Group A 
processed using Model d (see page 78) . 
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Standard deviation of 
standard deviation of 
errors ot ,7^C and .7 
Group B consisting of 
processed using Model 


(Rldj - ^ 7 ^) - GCj^ and the estimated 
GCj^ due to radiosonde measurement 
mb versus azimuth. Elevation = 10°. 
10 arbitrary data sets from Group A 
b (see page 78 ). 





The approximate value of a linear model is given by 

(6-16) . Letting n *« 8 

a * 455.57 

p « 140 kilometers > mean distance of sites 51 
through 58 from site 54 
E * 10“ 

the approximate error given by (6-16) is 

Approx. (GCj^)g^^ ■ .40 centimeters. (6-2 

If we neglect errors connton to both the ray trace and GCj^» the 
total error (o^) in any evaluation of GC^ may be divided into two parts. 
The first consists of errors in the formula itself (Op) . The second 
contribution is due to errors in the radiosonde data (jp). Because 
the radiosonde data errors and the formula errors are uncorrelated , 
we can write 

o2 = o2 + o2 . (6- 

From the results of (6-22) is approximately .5 centimeters. The 

standard deviation of |rT^ - GC^ * » from Tables 1 through 4, 

is approximately 1.1 centimeters. Substituting these values into (6-24), 

one finds Op = 1.0 centimeters. This assumes the radiosonde data were 

in fact accurate to .7“C and .7mb. Changes in the accuracy of the 

radiosonde lata will affect the accuracy of GC, . In Figure 24 (GC, )„ , 

1 1 otd 

has been replotted for various values of the relative error in p T K . 

By referring to the 10, 20, or 40 degree elevation axis, it is possible 
to determine the errors In due to radiosonde errors for any degree 
of radiosonde accuracy and elevation angle* 
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Figure 24. 


Standard deviation of attributable to terrors in the radiosonde 

tlata versus a/Jmutb tor several values of relative error in 
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The values of and Op used in perforslng the above error analysis 
(.7* C and .7 vb) were obtained from Hoidale et al (7]. It is not clear 
that the Haven Hop data achieved this level of accuracy. Frcm Figure 24* 
for CF^ “ 1.3* C and Op • .7 mb, the errors in GCj^ due to radiosonde 
errors (o^) would approximately equal the residual errors found in our 
data (o^ 2 1 cm). Thus a 1.3* teiq>erature error could account for almost 
the entire residual error in the corrected data. 

The pressure and temperature errors inherent in the Haven Hop 
data can be estimated by calculating the variance of the surface measure- 
ments about the regression polynomial. Using this approach and the 31 
data sets in groups A, B and C, the pressure and temperature variances 
were estimated to be 0.8 mb and 1.3*C .respectively. The estimated 
pressure error is very close to the value reported by Hoidale et al.[7]. 

The estimated temperature error is almost twice as large as the value 
reported by Hoidale but appears to be realistic. Although actual instru- 
mentation errors may be only 0.7*C, terrain features and ground cover 
variations could easily introduce an additional degree Centigrade or more 
error. Consequently, we believe the pressure errors in the Haven Hop 
data are close to the 0.7 mb value predicted by Hoidale while the temperature 
errors are close to the 1.3*C value which was estimated from the regression 
analysis. 

GC^ was evaluated to obtain a bound on the error Introduced by the 
neglect of higher order terms in (2-8). Details of this evaluation are 
given in Appendix V. Variations in GC^ were largely due to errors in 
the radiosonde data. In addition, little correlation was found between 
GC 2 and the residual errors (RT^ - RTj^) - GCj^. 
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VII. CONCLUSIONS 


A correction formula has been developed to correct laser ran ging 
data for the effects of horizontal refractivity gradients. The formula 
requires the values of the horizontal pressure and temperature gradients 
at the laser site. The gradients can be determined by measuring the 
surface pressure and temperature at various locations around the ranging 
site and using polynomial regression to obtain a least squares fit to 
the surface data. The gradients can then be calculated directly from 
the regression polynomial. 

The accuracy of the gradient correction fonsula was evaluated by 
comparing it with ray trace corrections. For a fixed elevation angle, 
the ray trace results indicate that horizontal refractivity gradients 
introduce refraction errors which a *e approximately sinusoidal functions 
of azimuth. The errors are minimum near 0* azimuth (due north) and 
maximum near ISO" azimuth (due soi'th). The average error has a peak-to- 
peak variation of approximately 5 ctatlmeters at 10° elevation and 
approximately 1.25 centimeters at 20° elevation. The gradient correction 
formula is very effective in compensating for this sinusoidal bias error. 
The correction formula reduces the peak-to-peak value of the mean error 
to less than 1 centimeter at 10° elevation and less than 2 millimeters 
at 20° elevation. 

When the gradient correction is applied to the ray trace data, the 
standard deviation of the residual error is approximately 1 centimeter 
at 10° elevation and 3 millimeters at 20° elevation. This residual 
error appears to be due almost entirely to errors in the meteorological 
data which are used to calculate the gradient correction term. The 
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residual error can be reduced either by using aore accurate surface 
data or by eiqkloylng additional %reather stations to obtain a aore accurate 
regression fit to the surface data. Tcnperature errors are the doalnant 
factor in the gradient correction formula. If an adequate weather station 
network is not available, it may be sufficient to correct the ranging 
data by simply subtracting the bias err..'. 

The analysis in this report did not consider the problra of extra- 
polating weather measureaents to different altitudes. This could potenti- 
ally be a Mjor error source, particularly in mountainous regions such as 
Califomla where weather stations may be located at widely different 
a Itltudes . 
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APPENDIX I. 

DATA USED IN THE ERROR ANALYSIS OF SECTION IV 

The coordinates of the radiosonde release sites used in evaluating 
the X matrix [Eq. (6-7)] are given below. 


SITE 

0* 


51 

50.464 

-76.227 

52 

51.000 

-77.454 

53 

50.857 

-75.464 

54 

51.643 

-76.627 

55 

51.929 

-78.136 

56 

52.500 

-77.336 

57 

52.929 

-76.345 

58 

52.072 

-75.409 


The variance-covariance matrices using the above site coordi- 
nates to evaluate Eq. (6-18) are given below for the linear, four- 
coefficient, and quadratic models. 


Linear Variance-Covariance Matrix 


5A9. 13075 
-450.52012 
L 136.01330 


-450.52012 

1457.77028 

823.79511 


136.01330 

823.79511 

837.86486_, 


2 

0 


Four-ccefficient Variance-Covariance Matrix 


C = 


3020051.7181 

-3358552.1110 

2880027.4701 

-3202187.263 


-3358552.1110 

3736127.9583 

-3202011.0430 

3561272.0412 


2880027.4678 

-3203011.0410 

2747573.3137 

-3054129.4360 


-3202187.2600"^ 

3561272.0384 

-3054129.4350 

3395924.6475 


2 

0 




\ 
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Quadratic Variance-Covariance Matrix 


4726008. 

-7183420. 

2840533. 

-7183493. 

20023166. 

3525662. 

2840470. 

3525802. 

8464536. 

5163020. 

-13857120. 

-2096712. 

6980564. 

-19130721. 

-3157613. 

^ 3578159. 

-4292204. 

3128791. 


5162797. 

6980394. 

3578093 

-13856861. 

-19130570. 

-4292159 

-2096916. 

-3157809. 

3128703 

44644448. 

33624533. 

18191508 

33624389. 

30132794. 

12957445 

18191410. 

12957413. 

9309160 


T 

The four-coefficient and quadratic XX matrices are ill-conditioned. 


Consequently computer round off errors have made them non symrotrical 
The effects on the regression analysis are negllgable. 
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APPENDIX II. 

DISTANCE AND AZIMUTH TO LATITUDE AND LONGITUDE 


Evaluation of GCj^ using Method II of Section II requires the 

determination of the latitude and longitude of an auxiliary site. Point 1, 

a given distance and azimuth from the ranging site. Point 0. 

Let and De the longitudes of Point 0 and 1 measured from the 

prime meridian, a is the azimuth of Point 1 relative to Point 0. Let 

and 6, be the colatitudes of Points 0 and 1. p , is the horizontal 
o 1 ol 

distance from Point 0 to Point 1 measured along the earth's surface. 

From Figure II-l, C is the angle between Points 1 and 2 measured 
with respect to the center of the earth. 


ol 


where r^ is the radius of the earth. Using the law of cosines. 


cos 9, * cos 9 cos + sin 0 sin cos a 

1 or or 

e e 


= cos 


-1 


^oi 

cos 6 cos + sin 6 sin cos 

or or 




Defining A0 » and using the law of sines » 


sin sin C 


sin a sin A0 


A(() * sin 


-1 


sin a ^ ^ol 

~ — — sin 

sin 0- r 

1 e 


(fc, * + 6 

1 o 


^1 = 4>o + sin 


-1 


sin a , ol 

— sin 

sin 0, r 

1 e , 


1. f 


i 


I 


1 


1 



1 



» 


f 


NORTH POLE 



POINT 0 


POINT I («#>, . 0 ,) 


Figure II~1. Geometry used in expressing 0 and as functions of p. 
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APPENDIX 111. 


3F 

EVALUATION OF ~ AND 
3p 



From Appendix II 


0 


-1 

c 


» cos 1 cos 0 cos + sin 0 sin cos a 

or or I 

e e ^ 


^ ^ sin 

o 


sin a 

~ — — sin — 
sin 6 r 


where 


(III-l) 

(IH-2) 


6^ « colatitude of ranging site 
(j)^ * longitude of ranging site 

0 = colatitude of a point a distance p and azimuth a from 

the ranging site 

(p * longitude of a point a distance p and azimuth a from the 
ranging site 

r » radius of the earth 
e 

a « azimuth of point 1 relative to the ranging site. 


Derivative of F-linear case 

Let F be a pol 3 rnomlal expansion of the form (6-2). For the linear 


case 


F » F + 0 • F^ -f 4) sin 0 • F^ . 

r 0 (p 


(III-3) 


Using the chain rule 


To determine 


II 

3p 


p«0 


II ^ IZ II + II li 

3p 36 3p 3p 

it is necessary to calculate 


(III-4) 


\ 


I i 1 





. -I 
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3F 

B 

8F 


36 

U 

3F 

\ 

Im! 1 

3o 

o 

If 

Q. 

86 

P“0 

8p 

p-c) ' 

[3P 

P=0j 



(III-5) 


Using (III-l) and letting x = 
86 _ 8 cos ^ (x) 

8p 8p 


\ 


cos 6 cos + sin b sin cos a 

or or 

e e 


-1 8x 


8p 


(1 - 


1 - cos 6 cos sin 0 sin cos a 

or or 

e e 


-cos 6 p sin 0 cos a P 

sin + cos 

r r r r 

e e e e 


- 1/2 


(I1I-6) 


(III-7) 


ii 

3p 


-sin 6 


p=0 


5 cos a (~ 

-2 1 _ 

r 

p 


2 , 
cos 0 


- 1/2 


(III-8) 


ap 


-cos a 


|p*0 < 

Using (III-2) 


(I.I-9) 


8(j) 8 , - 


sin a 


sin 0 


sin 


( 


sin a 


^in 6 
and letting p = 0 


'i I " 

— (COS sin 0 

. r r 

Lei e 


- cos 0 


80 I 

— sin 
{^p r 


e y 






(JIl-10) 


8p 


sin a 


^ r sin 0 
p=0 e o 


an-1 1) 


““ and 4“ t*re determined using (111-3), 

au 




1 
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96 


P«0 


F* + ♦ cos e • 

0 O 6 


p-0 


■ sin 0 • F. 

o 6 


(III-12) 

(111-13) 


Substituting (III-13), (III-12), (III-ll), and (III-9) into (III-4) 


3p 


-cos a 


sin o F, 


p«0 


(F + ♦ cos 6^ • F. ) + 

V O O <p 


Derivative of F-quadratic case 
For the quadratic case let 


F - F, + 0 • F* + ♦ sin 0 • F^ + 00 sin 0 • F*^ 

& U ^ 

* • ^96 * ■ 


(111-14) 


Using the chain rule (I1I-4) to differentiate (111-14) 


36 

3^ ’ 9^ ^^6 ® ‘ ® * ^06 ® 

+ 26 • F-„ + 2 sin 0 cos 0 * F^^] 

uu 9 t 

+ [sin 6 • F. + 0 sin 9 • F„. + 2^ sin^ 0 • F. . ] . 

ap ^ (fMp 

(III-15) 

Evaluating at p > 0 and using (111-11) and (111-9) 

-cos a 


3F 

3p 


p*0 


[F- + A cos 0 • F. + ♦ sin 0 • F. . 

0 O 0^0 o 6^ 

+ ^^6^ cos 0^ • F.. + 26^ • F + sin 20^ • F,. ] 

O O O O O O (|)9 


Sin a 


IK + e * Fa* sin ^ * F*J 


(111-16) 
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Evaluation of — ^ -quadratic case 

aef 


The chain rule nay be applied again to (III-4) giving 


7 ^ 3<^ . aF a^e . a^F ih \^ ^ 3f a^ 

,p2 ,e2U »„ 17 V'’-' ^ ^ 


where only nonzero terns have been retained. 


(III-17) 


Lettlog a . _2i 

sin 0, r 
1 e 


♦ ■ 6^ + sin ^ u 


ii n 2 au 


ii- . _ i 


-3/2 


- 1/2 


ap 


(l-u^) (.2u)(^% ^ (1 - u^) (111-18) 


3p 


Braluating (111-18) at p = 0, we obtain 


»!i 


+ 2 cos 8 sin a cos a 
o 


p«0 


sin^ e 
e o 


(111-19) 


Similarly 


3^0 


3p 


1 2. 
(1 - X ) 


-3/2 


p-0 




3‘^x ,, 2. 
— 5 (1 - X ) 
3p 


- 1/2 


Evaluating at p « 0 


3^0 


3p' 


1 I 2 i“3/2 

■:7 II - cos 6 I (-2 cos 0 ) 
^ I 0 | o 


2 2 
sin 0 cos a 
o 


p*0 


, »o I, 2 „ 


)l 


e 

cos e 


O /-i 2 . 

— (1 - cos a) 


r sin 0 
e o 


r^TT 


1, 




/ 


3^0 


cos 0 sin 
0 


P“0 

r^ sin 0 
e 1 


(III-20) 


When F is given as in (III- 14), the other derivatives in (III-17) are as 
given below. 


“ Fa ♦ cos • F. + F-.[ 8 in 0 +0 cos 0 ] ♦ +20 • F.. 

30 0 o o 4 04 o o o' ^o o 00 

p *0 


+ 4 sin 20 • F,^ 

o o 44 


(111-21) 


-2 ■ -*0 ®o • % + t2 CO. 9^ - 9„ .In 9„1 • F 

' 0-0 

* 2 • fee + “o • 

- sin 0 • F, + 0 sin 0 • F„^ + 24 sin 0 • F^^ (111-23) 

34 - 040 o 04 o 44 

p =0 


3^F 2 

^ - 2 sin-^ 0„ • F. . 

„2 o ♦♦ 

P«0 


(III-24) 


an a. = cos 0 *F. + sin 0 *F-, + 9 cos 0 • F„. + 24 sin 20 • 

a© 3 ^ o ^ o 6 ^ o o 66 ^ o d 

p *0 

(III-25) 

Substituting (III-9), (III-ll), (III- 19), (111-20), and (III-21 through 
25) into (111-17) and collecting terms 


2 

cos a 


00 n 

p *0 e 


(i sin 0 • F. + (2 cos 9-6 sin 6 )4 ’F„. +2 • F.„ 

^o 04 00 0 0 04 09 


+ 24 cos 29 • F. . 

o o 44 


2 cos a sin j t g ^ • F . + sin 0 • F„ . + 9 cos 0 • F. . 

2.„ I 04 0040 0 04 

r sin 0 •» 

e o 

+ 24 sin 29 • F. . 1 
o o 44 1 
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APPENDIX IV. FORM OF THE STANDARD DEVIATION OF GC^ 

The standard deviation of GCj is determined using the first term of 
Eq. { 1 - 22 ). The second texm* which is much smaller, is neglected. 


] - ^ (p T K ^ 

1 sin E tan E 3p ^ s s 


(IV-1) 


For any modeling of ®ay be written as 


GC« “ G cos Qt sin oi 

In e 


(IV-2) 


where G,^ is the north-south gradient correction and is the east-vest 
correction. The standard error in GC^ can be written as 

I 2 2 2 ^ \ 

(GC.) = jo^, cos a + - cos a sin a + o_ sin a I (IV-3) 

^ Std I ^ ^ / 


- s' - <S>' 


S - <S> 


(IV-4) 


NE N E N E 


Equation (IV-3) can be simplified by assuming that G^ and are uncorrelated 

2 2 

and n ^ . It seems reasonable to assume that G,, and G^ are uncorrelated 

WE N E 

sinre the north-south gradient is primarily affected by seasonal variations 
in climate while the east-west gradient is essentially a diurnal effect. The 
Haven Hop data indicate this assumption is valid so that Equation (IV-1) can 
he .i?ritten as 


T 

T 

“ 

} F 

. 1 .... 1 . 

1 

- 1 

1 ,V, ... 1 . 

..k , 1 




1 _ ... 1 ^ i 
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(GC^) 


I 2 ^ 2 


8td 


1/2 ^22 

1 + cos 20 

[ J- 


1/2 


(IV-5) 


The Haven Hop data also indicate a = a so that Equation (IV-5) can be 

N £ 

approximated using the binomial theorem 


(GC^) 


std 


2 2\ r 

^ [■ 


2 2 
o — o 

1 + 1/2 -^^2 ^ cos 2o| 

a + o 
N E 


(IV-6) 


(GC. ) is a sinusoid of frequency 2a where a is the azimuth angle. 

^ std 

The form of (lV-6) may be compared with the standard deviation of GC^ obtained 
using the data of Project Haven Hop I. In Fig. lV-1 the standard deviation 
of GC^ for Group/!k>del Bd and an elevation of 10^ has been plotted versus 
azimuth. From the figure it is clear the standard deviation of GC^ contains 
sinusoidal variations at a frequency 2a superimposed on a constant bias level 


in agreement with (lV-6). 
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APPENDIX V. EVALUATION OF GC, 


An estlniar:e of the error Introduced into the gradient correction 
formula (2-8) by neglecting the higher-order terms of GC can be obtained 
by evaluating the second term in the series, GC^* 


2.029 f(A) 3^ Ps^i 


2 2 2 i 2 

sin E tan E 3p \ ^ 


As in Section VI we can estimate the effect of errors in the radio- 
sonde data. If we let 


„ „ 2„2 / 2 2 2 
“ °T . °P 

' S SI 


where 


- 2T T \ 

“*2-1.04x10-3 

S si 


then the estimated standard deviatioa of G is 


Std sin E tan E k=l £»1 3p 3p 


2 2 
3 X, 


Equations (V-1) through (V-3) were calculated for quadratic modeling 


2 2 

^ P T K . 
of s s 8 and 

2 - K 


P - 1000 mb 
s 

T = 275“ K 

s 


K * . 

s 


88913 


I 



1 i 
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- .r K 

a ■ .7 mb 
P 

E = 10® . 

I 

The derivatives of the coordinate polynomials are available from Appendix III. 

The variance-covariance matrix C and the colatitude and longitude of the 
release sites are given in Appendix I. 

GC 2 was evaluated using (V-1) and the radiosonde data of Group /Model Bd. 

For each azimuth the standard deviation of GC 2 was computed. The estimated 
standard deviation of GC 2 given by (V-3) and the actual standard deviation 
of GC 2 have been plotted versus azimuth in Figure (V-1). Both curves are on 
the same order of magnitude. This indicates errors in the radiosonde 
data are primarily responsible for variations in GC 2 . The mean of GC 2 was 
approximately -4 mm. Figure V-2 shows GC 2 and A = (RT^ - ^^1^ * data 

of 0930 1/26/70. The figure shows little correlation between GC 2 and the 
residual errors A. 



T 
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STANDARD DEVIATION (cm) 
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Figure V-1. Standard deviation of GC^ calculated using Haven Hop data 
(Std[GC 2 ]) and the estimated standard deviation of GC^ due 
to errors of .7*C and .7 mb in the radiosonde data versus 
azimuth. Group B (10 data sets). Model d. Elevation « 10". 
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AZIMUTH 

Figure V-2. GC 2 and (RT^ - RTj^) - GCj^ versus azimuth. Data of 0930 
1/26/70. Group B, Model d, E • 10*. 
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APPENDIX VI. SUMMARY OF PROCESSED DATA SETS AMD MODELS 

A brief summary of the processing methods Is given In Table VI-1 
below. 



Table Vl-1. Pr''cessing Methods and Data Sets of Section V 


Group/ Number of Number of radio- Regression model Calculation 


Model 

data sets 

sonde balloons 

for surface data 

of derivative 

Aa 

21 

8 

Quadratic 

Approximate 
Method I 

Ba 

10 

8 

Quadratic 

Approximate 
Method I 

Bb 

10 

8 

Linear plus 
cross term 

Approximate 
Method I 

Be 

10 

8 

Linear 

Exact Method 
II 

Bd 

10 

8 

Quadratic 

Exact Method 
III 

Cb 

10 

7 

Linear plus 
cross term 

Approximate 
Method I 






Ray trace 
refractivity 
model 

Quadratic 

Quadratic 

Linear plus 
cross term 

Quadratic 

Quadratic 

Linear plus 
cross term 
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